BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on EVT-TOTAL events by Ev. Decom. - Approx. Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]       ==[EVT-TOTAL]==       1580 (  925)     1308 (  925)    58.54    70.72    64.06
[VIBGhent ]       ==[EVT-TOTAL]==       1580 (  806)     1143 (  806)    51.01    70.52    59.20
[JULIELab ]       ==[EVT-TOTAL]==       1580 (  847)     1353 (  847)    53.61    62.60    57.76
[UT+DBCLS ]       ==[EVT-TOTAL]==       1580 (  786)     1143 (  786)    49.75    68.77    57.73
[ConcordU ]       ==[EVT-TOTAL]==       1580 (  705)      952 (  705)    44.62    74.05    55.69
[ UTokyo  ]       ==[EVT-TOTAL]==       1580 (  693)     1087 (  693)    43.86    63.75    51.97
[ UZurich ]       ==[EVT-TOTAL]==       1580 (  655)     1047 (  655)    41.46    62.56    49.87
[ UNIMAN  ]       ==[EVT-TOTAL]==       1580 (  648)     1044 (  648)    41.01    62.07    49.39
[ASU+HU+BU]       ==[EVT-TOTAL]==       1580 (  599)      850 (  599)    37.91    70.47    49.30
[  UNSW   ]       ==[EVT-TOTAL]==       1580 (  623)      995 (  623)    39.43    62.61    48.39
[ Team 24 ]       ==[EVT-TOTAL]==       1580 (  580)      948 (  580)    36.71    61.18    45.89
[  SCAI   ]       ==[EVT-TOTAL]==       1580 (  601)     1044 (  601)    38.04    57.57    45.81
[   Cam   ]       ==[EVT-TOTAL]==       1580 (  525)      744 (  525)    33.23    70.56    45.18
[UAntwerp ]       ==[EVT-TOTAL]==       1580 (  560)      907 (  560)    35.44    61.74    45.03
[  NICTA  ]       ==[EVT-TOTAL]==       1580 (  500)      791 (  500)    31.65    63.21    42.18
[ USzeged ]       ==[EVT-TOTAL]==       1580 (  641)     1473 (  641)    40.57    43.52    41.99
[ UAveiro ]       ==[EVT-TOTAL]==       1580 (  506)      869 (  506)    32.03    58.23    41.32
[CNBMadrid]       ==[EVT-TOTAL]==       1580 (  746)     2038 (  746)    47.22    36.60    41.24
[CCP-BTMG ]       ==[EVT-TOTAL]==       1580 (  390)      491 (  390)    24.68    79.43    37.66
[CIPS-ASU ]       ==[EVT-TOTAL]==       1580 (  543)     1422 (  543)    34.37    38.19    36.18
[  PIKB   ]       ==[EVT-TOTAL]==       1580 (  353)      493 (  353)    22.34    71.60    34.06
[  UMich  ]       ==[EVT-TOTAL]==       1580 (  804)     3751 (  804)    50.89    21.43    30.16
[ KoreaU  ]       ==[EVT-TOTAL]==       1580 (  303)      467 (  303)    19.18    64.88    29.60
[ Team 09 ]       ==[EVT-TOTAL]==       1580 (  371)      935 (  371)    23.48    39.68    29.50

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]       ==[EVT-TOTAL]==       1722 (  842)     1218 (  842)    48.90    69.13    57.28
[ASU+HU+BU]       ==[EVT-TOTAL]==       1722 (  599)      850 (  599)    34.79    70.47    46.58
[ Team 24 ]       ==[EVT-TOTAL]==       1722 (  626)     1007 (  626)    36.35    62.16    45.88
[UAntwerp ]       ==[EVT-TOTAL]==       1722 (  562)      912 (  562)    32.64    61.62    42.67
[CNBMadrid]       ==[EVT-TOTAL]==       1722 (  813)     2426 (  813)    47.21    33.51    39.20
[CCP-BTMG ]       ==[EVT-TOTAL]==       1722 (  407)      508 (  407)    23.64    80.12    36.50

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------